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TITLE OF THE INVENTION 
Image Coding Apparatus 
BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image coding apparatus and more 
particularly to an image coding apparatus for coding a dynamic image. 
Description of the Background Art 

An MPEG2 standard to be an international standard for image compression has 
been used for a digital AV apparatus such as a rerecording type DVD, a D-VHS or a 
digital broadcasting transmitter. 

In an MPEG2 coding processing, a deterioration in an image is comparatively 
small and a picture quality can be increased at a comparatively high bit rate (for example, 
4 to 6 Mbps in a DVD). However, a time required for picture recording is limited 
depending on a recording medium. For this reason, it is desirable that coding should be 
carried out at a comparatively low bit rate (for example, 2 to 3 Mbps in the DVD). In 
this case, there has generally been employed a method of previously converting a coding 
object image to have a size of 4/3, 2/3 or 1/2 by an image size converter (a resolution 
converter) and carrying out the MPEG2 coding for an image having the same size. 
However, a resolution of a current image is deteriorated, and furthermore, the coding 
processing is carried out at a low target bit rate. Consequently, the picture quality is 
greatly deteriorated so that an increase in the picture quality is hindered. 

As a dynamic image coding apparatus corresponding to the MPEG2, Japanese 
Patent Application Laid-Open No. 2002-16912 has disclosed a dynamic image coding 
apparatus using a 2-path coding method in which only one coder is used and a scale 
thereof is reduced. However, this processing carries out multiplexing and separation for 
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data. For this reason, there is a problem in that the processing is complicated. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to obtain an image coding apparatus 

capable of efficiently implementing a 2-path coding processing without increasing 

* 

5 hardware (a resource for coding). 

A first aspect of the present invention is directed to an image coding apparatus 
including a dynamic image coder and a coding control section. The dynamic image 
coder inputs a video signal defining a dynamic image and carries out first and second 
coding processings for the video signal, to output an output bit stream signal. The 
10 coding control section controls a coding operation of the dynamic image coder. In this 
case, the coding control section controls the dynamic image coder to continuously carry 
out the first and second coding processings without providing a pause period within a 
predetermined period. 

By using one dynamic image coder, it is possible to prevent an increase in a 
15 resource in coding based on the first and second coding processings. In addition, it is 
possible to efficiently carry out a 2-path coding processing by continuously performing 
the first and second coding processings without providing the pause period within the 
predetermined period. 

These and other objects, features, aspects and advantages of the present 
20 invention will become more apparent from the following detailed description of the 
present invention when taken in conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a structure of a general image coding 
apparatus in accordance with MPEG2, 
25 Figs. 2A to 2D are explanatory diagrams showing various video formats, 



Fig. 3 is a block diagram showing a structure of a general 2-path coding 
apparatus, 

Fig. 4 is a block diagram showing a structure of an image coding apparatus 
according to a first embodiment of the present invention, 

Fig. 5 is an explanatory diagram showing contents of an MPEG2 coding 
operation period assignment in 1 -path coding, 

Fig. 6 is an explanatory diagram showing the contents of the MPEG2 coding 
operation period assignment according to the first embodiment, 

Fig. 7 is an explanatory diagram showing a memory map of an external DRAM, 

Fig. 8 is an explanatory diagram showing a specific example of contents of a 
2-path coding processing to be carried out by a coding LSI according to the first 
embodiment, 

Fig. 9 is a flowchart showing a flow of the 2-path coding processing according 
to the first embodiment, 

Fig. 10 is an explanatory diagram showing a 2-path coding sequence to be 
executed by a coding LSI according to a second embodiment, 

Fig. 11 is an explanatory diagram showing a memory map in an SDRAM 
memory area of an external DRAM according to the second embodiment, 

Fig. 12 is an explanatory diagram showing a 2-path coding sequence to be 
executed by a coding LSI according to a third embodiment, 

Fig. 13 is an explanatory diagram showing a memory map in an SDRAM 
memory area of an external DRAM according to the third embodiment, and 

Fig. 14 is a block diagram showing a structure of an image coding apparatus 
according to a fourth embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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<Premise Technique> 

Fig. 1 is a block diagram showing a structure of a general image coding 
apparatus in accordance with MPEG2 which is a premise technique to understand the 
present invention. 

5 As shown in Fig. 1, the image coding apparatus is constituted by a coding LSI 

101 and an external DRAM 111. The general coding LSI 101 is constituted by an 
MPEG2 coder 102, a parameter input section 108, a parameter output section 109, an 
SDRAM interface section 1 10, a video input terminal 1 12, a video output terminal 1 13, a 
parameter input terminal 116, a parameter output terminal 117 and a bit stream output 
10 terminal 114. 

The MPEG2 coder 102 is constituted by a coding control section 107, a video 
signal input/output section 103 to be a signal processing section, a motion 
predicting/motion compensating section 104, a DCT/Q and IQ/IDCT section 105, and a 
variable-length coding section 106. These components execute coding while writing 
15 and reading data to and from an SDRAM (an external DRAM 1 1 1) on a functional block 
unit (a data unit transmitted and received by each of the components 103 to 106), 
respectively. 

The coding LSI 101 has six kinds of input/output ports (terminals), that is, the 
video input terminal 112, the video output terminal 113, the bit stream output terminal 

20 114, an SDRAM port 115, the parameter input terminal 116, the parameter output 
terminal 117, the coding parameter input port 108, the coding parameter output port 109 
and the bit stream output port 114. Moreover, an I/O bit width of the external DRAM 
111 is substantially supposed to be 16 bits, 32 bits, 64 bits and the like because of 
restrictions on the number of pins (I/O pins) of an LSI. 

25 A video input signal SV1 input from the video input terminal 112 is subjected 
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to filtering and feature extraction processings by the video signal input/output section 103. 
The video signal input/output section 103 executes a resolution conversion processing for 
converting a coding object image size over the video input signal SV1 if necessary. 

Figs. 2A to 2D are explanatory diagrams showing various video formats. The 
5 resolution conversion processing will be described below with reference to Figs. 2A to 
* 2D. Fig. 2A shows the most general video format which is obtained when a current 
television signal (NTSC signal) is digitized, which will be hereinafter referred to as a Dl 
format. The Dl format has a resolution of 720 pixels X 480 lines and is used according 
to a standard in general digital AV apparatuses (a DVD, an STB (Set Top Box) and a 
10 digital video). 

On the other hand, a format shown in Fig. 2B is referred to as a 3/4 Dl format 
and is constituted by 544 pixels X 480 lines, a format shown in Fig. 2C is referred to as a 
2/3 Dl format and is constituted by 480 pixels X 480 lines and a format shown in Fig. 2D 
is referred to as a 1/2 (half) Dl format and is constituted by 352 (360) pixels X 480 lines. 

15 For example, in an application intended for a current TV such as a DVD or digital 
broadcasting, the Dl format is usually used. In the case in which a signal throughput of 
hardware to be an object is insufficient or coding is carried out at a lower bit rate than 
usual, the 3/4 Dl format, the 2/3 Dl format or the half Dl format is properly used if 
necessary. For this reason, the MPEG2 coding apparatus is basically provided with a 

20 resolution converting circuit. 

Fig. 3 is a block diagram showing a structure of a general 2-path coding 
apparatus. The 2-path coding apparatus shown in Fig. 3 has such a structure that the 
MPEG2 coding apparatuses 102 illustrated in Fig. 1 are cascade connected in two 
systems. 

25 With reference to Fig. 3, a conventional 2-path coding method will be briefly 



6 

described below. An MPEG2 coding apparatus 21 in a first stage inputs a video input 
signal SV1 to be a coding object and sequentially carries out an MPEG2 coding operation. 
At this time, various parameter information for the execution of the coding are stored in 
an optional area of the external DRAM 111. The coding parameter includes motion 
5 prediction information about each macro block, macro block type decision information, 
quantization information, a generated coding amount and the like. 

These coding parameter information are output as parameter information DP 12 
through a parameter output section and are input as parameter information DP21 to a 
parameter input section of a coder in a second stage. An MPEG2 coding apparatus 22 in 

10 the second stage obtains a delay video input signal DSV1 to be a coding object through a 
flame delay unit 23. More specifically, the MPEG2 coding apparatus 22 inputs the 
delay video input signal DSV1 subjected to a necessary frame delay by the frame delay 
section 23 from the video input signal SV1 and sequentially executes MPEG2 coding to 
transmit a bit stream signal SBS2. At this time, in each coding stage, the parameter 

15 information DP21 (DP 12) of the MPEG2 coding apparatus 21 in the first stage is input 
from the parameter input section and determines an optimum coding parameter for the 
MPEG2 coding apparatus 22 in the second stage with reference to necessary coding 
parameters (coding parameters obtained by the MPEG2 coding apparatus 21 in the first 
stage) on units of a picture layer, a slice layer and a macro block layer. 

20 According to the structure described above, the 2-path coding can be 

implemented in all cases. For this purpose, 2-system (two or more) MPEG2 coding 
apparatuses and a frame memory for implementing a frame delay are required. In the 
present invention, there will be described a technique and an image coding apparatus for 
efficiently implementing 2-path coding by using a 1 -system (one) MPEG2 coder. 

25 <First Embodiment 



Fig. 4 is a block diagram showing a structure of an image coding processing 
according to a first embodiment of the present invention. As shown in Fig. 4, the image 
coding apparatus is constituted by a coding LSI 401 and an external DRAM 411. 

The coding LSI 401 is constituted by an MPEG2 coder 402 (a dynamic image 
coder), an SDRAM interface section 410, a video input terminal 412, a video output 
terminal 413 and a bit stream output terminal 414. 

The MPEG2 coder 402 is constituted by a coding control section 407, a coding 
parameter input/output section 416 and each signal processing section. The signal 
processing section is constituted by a video signal input/output section 403, a motion 
predicting/motion compensating section 404, a DCT/Q and IQ/ IDCT section 405, and a 
variable-length coding section 406, and respective operations are controlled by the coding 
control section 407 and a parameter input/output section 408 is also controlled by the 
coding control section 407. 

A connecting relationship between the signal processing sections will be 
described below in detail. The video signal input/output section 403 carries out a signal 
processing including a resolution conversion processing upon receipt of a video input 
signal SV1 (a video signal defining a dynamic image) from the video input terminal 412, 
outputs a video output signal SV0 from the video output terminal 413, and gives a signal 
processing result to the motion predicting/motion compensating section 404. 

The motion predicting/motion compensating section 404 carries out a motion 
prediction and a motion compensation based on the signal processing result of the video 
signal input/output section 403, and gives the signal processing result to the DCT/Q and 
IQ/IDCT section 405. 

The DCT/Q and IQ/IDCT section 405 carries out a discrete cosine transform 
(DCT) processing and a quantization processing (Q) for the signal processing result of the 
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motion predicting/motion compensating section 404 to obtain a signal processing result. 
In this case, an inverse discrete cosine processing (IDCT) and an inverse quantization 
processing (IQ) for feeding back the signal processing result are also carried out. 

The variable-length coding section 406 carries out a variable-length coding 
processing for the signal processing result of the DCT/Q and IQ/IDCT section 405 and 
outputs a bit stream signal SBS from the bit stream output terminal 414. 

The parameter input/output section 408 can input/output a coding parameter 
stored in the external DRAM 411, and can give the coding parameter through the coding 
control section 407 to the MPEG2 coder 402, the video signal input/output section 403, 
the motion predicting/motion compensating section 404, and the DCT/Q and IQ/IDCT 
section 405. 

Each of the components 403 to 406 executes the coding while writing and 
reading data to and from the external DRAM 4 1 1 (storage section) on a functional block 
unit. 

The coding LSI 401 has four kinds of input/output ports (terminals), that is, the 
video input terminal 412, the video output terminal 413, the SDRAM port 415 and the bit 
stream output port 414. Moreover, an I/O bit width of the external DRAM 411 is 
substantially supposed to be 16 bits, 32 bits, 64 bits and the like because of restrictions on 
the number of pins (I/O pins) of an LSI. 

It is assumed that the MPEG2 coder has such a capability as to process 30 
current TV images, that is, Dl format videos in one second (MP ML in an MPEG2 
standard). The throughput itself is equivalent to that of the conventional MPEG2 coder 
shown in Fig. 1 . Moreover, a coding parameter input terminal and a coding parameter 
output terminal are not assigned as external pins for the following reason. More 
specifically, it is basically assumed that a coding operation which does not need to input a 
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coding parameter from an outside or to output the coding parameter to the outside is 
carried out. 

The coding operation will be described with reference to Fig. 4. The input 
video input signal SV1 (NTSC signal) carries out the MPEG2 coding operation on a 
5 frame unit in accordance with the following sequence. A digitized video input signal (ex. 
an ITU-R-656 format) is first input to the video signal input/output section 403. Then, a 
signal processing result is written to an original picture area on the external DRAM 411. 
In Fig. 4, a compressing operation is executed on a macro block unit in order of DCT, 
quantization (Q) and variable-length coding. Then, an original picture bit stream is 
10 properly subjected to reordering (a processing of changing order of an image to be coded) 
and the coding is thereafter carried out in a picture type referred to as an I picture, a P 
picture or a B picture. 

Description will be given to a coding sequence in the P picture or the B picture 
requiring all data transfer operations. A template image for retrieving a motion is read 
15 through the external DRAM 411 and a coding object image is read from the external 
DRAM 411. 

Data on the external DRAM 411 are transferred to the motion predicting/motion 
compensating section 404 and the DCT/Q and IQ/IDCT section 405, respectively. In the 
motion predicting/motion compensating section 404, moreover, a bit stream in a 
20 necessary area for a search window in a reconfiguration image bit stream area prewritten 
simultaneously is transferred from the external DRAM 411 so that search window data 
can be obtained. 

Then, a prediction image is generated in accordance with an optimum motion 
vector obtained by the motion predicting/motion compensating section 404 and DCT and 
25 Q (quantization) processings are executed by the DCT/Q and IQ/IDCT section 405, and a 
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variable-length coding processing is then carried out by the variable-length coding section 
406. Finally, a bit stream signal SBS (an output bit stream signal) is transmitted from 
the bit stream output terminal 414. In the coding operation, an operation for coding the 
bit stream is executed in accordance with a picture sequence. This operation is collected 
5 in the following sequence of ® to (8). 

® Fetch original image data (a video input/output (input the video input 
signal SV1 and output the video output signal SVO) — > an external frame memory (the 
external DRAM 111)) 

(D Read a coding object image (an external frame memory — » a DCT/Q unit) (the 
1 0 DCT/Q and IQ/IDCT section 405) 

(3) Search a motion (retrieve integer precision) (search precision of one pixel) (an 
external frame memory — > a motion predicting/compensating unit (the motion 
predicting/motion compensating section 404)) 

® Search a motion (half pel (search with high precision of a 1/2 pixel)) (an external 
15 frame memory — > a motion predicting/compensating unit) 

(5) Generate a prediction image (an image on a macro block unit specified by a motion 
vector) (an external frame memory — > a motion predicting/compensating unit) 

(6) Write a reconfiguration image (an image on a macro block unit regenerated based on 
the prediction image) (a motion predicting/compensating unit — » an external frame 

20 memory) 

(7) Write and read coding data (a variable-length coding unit (the variable-length coding 
section 406 « > an external frame memory) 

(D Decoded image (an image for one screen of a reconfiguration image) (an external 
frame memory — » a video input/output) 
25 In the original image data fetching processing ® 3 an original image is stored in 
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a form obtained by executing a resolution conversion to carry out a conversion from the 
Dl format into the 3/4, 2/3 or half Dl format depending on a property of a video signal. 
From the processing (D and succeeding processings, a substantial MPEG2 coding 
operation is started. By two kinds of searching operations (3) and ®, it is possible to 
obtain a motion vector rapidly (a comparatively high-speed search by the search (3)) with 
high precision (a search with comparatively high precision by the search ®). Moreover, 
the prediction image is based on the motion vector obtained by the motion 
predicting/compensating unit. The reconfiguration image is obtained by carrying out 
inverse quantization (IQ) and inverse DCT transform over the prediction image. The 
coding data are obtained by coding a signal sent from the DCT/Q unit by means of the 
variable-length coding unit. 

Fig. 5 is an explanatory diagram showing contents of an MPEG2 coding 
operation period assignment in path coding. As shown in Fig. 5, it is necessary to assign 
a picture preprocessing period tpl, a picture postprocessing period tp2 and a macro block 
processing period TMB into one frame period (33.3 ms in NTSC). A black-colored 
portion shown in a first part of the frame period implies a frame synchronization pulse. 

In the case in which a video signal in the Dl format is to be coded, almost 
whole one frame period is assigned to a macro block processing period TMB1 to be a 
coding processing period. At time of start of a frame processing, a whole processing (a 
picture preprocessing) for determining a coding parameter related to a whole frame, for 
example, determining a picture type of the frame and determining a target bit amount (a 
target compression bit amount) and for initializing each hardware is carried out. A 
period required for the picture preprocessing is the picture preprocessing period tpl. 

Then, the coding operations (2) to (8) are carried out on a macro block unit for 
the macro block processing period TMB1 . 
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When the macro block processing period TMB1 is ended, a necessary 
postprocessing (picture postprocessing) in the frame, for example, calculation of an 
amount of generated bits or the like is carried out and the coding operation in the frame 
(picture) is completed. A period required for the picture postprocessing is the picture 
postprocessing period tp2. 

The picture preprocessing period tpl and the picture postprocessing period tp2 
are several tens \x sec respectively and most of the time is assigned to the macro block 
processing period TMB 1 . 

Referring to Fig. 5, description will be given to a coding object image in the 
half Dl format, for example. In the half Dl format, an object image size is a half of that 
in the Dl format. Therefore, the number of micro blocks to be processed is also halved. 
More specifically, the Dl format has 1350 MB (macro blocks) per frame, while the half 
Dl has 660 MB per frame. For a macro block processing period TMB2 in the half Dl 
format coding, therefore, the coding operation is ended in almost a half of a time required 
for the macro block processing period TMB1 in the Dl format coding as shown in Fig. 5 
and a residual period is set to be a processing pause period TR2. Also in the coding 
operation in a 3/4 Dl format, similarly, approximately 3/4 of the frame period is used and 
residual 1/4 is set to be a pause period TR3. 

Fig. 6 is an explanatory diagram showing contents of an MPEG2 coding 
operation period assignment to be carried out by a coding LSI according to the first 
embodiment of the present invention. 

With reference to Fig. 6, a coding operation according to the first embodiment 
will be described below. In the case in which a resolution conversion is executed by the 
video signal input/output section 403, the coding operation is carried out, that is, first and 
second coding processings are continuously carried out without providing a pause period 
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for two frames (intended for the same frame (an nth frame) in the first embodiment) 
within one frame period (a predetermined period) by utilizing the pause period (TR2, 
TR3) in Fig. 5 and a 2-path coding operation is thus implemented equivalently. 

In Fig. 6, a period assignment to be carried out when coding a video (frame) in 
5 the half Dl format is shown. As shown in Fig. 6, macro block processing periods 
TMB21 and TMB22 to be periods for a 2-path coding processing in the half Dl format 
are provided for one frame and the 2-path coding processing in the half Dl format is 
executed within one fame. Picture preprocessing periods tpll and tp21 are provided 
before the macro block processing periods TMB21 and TMB22, and picture 

10 postprocessing periods tpl2 and tp22 are provided after the macro block processing 
periods TMB21 and TMB22. 

When coding in an nth frame (the half Dl format) is to be carried out, the 
MPEG2 coding operation is once executed for a first half period (the macro block 
processing period TMB21). At this time, various coding parameters generated in the 

15 coding (see the following) are stored in a coding parameter area of the external DRAM 
411 through the SDRAM interface section 410 by the parameter input/output section 408 
in Fig. 4. In the present embodiment, the coding parameters are classified into a picture 
level and a macro block level (to which a storage area is assigned for each macro block) 
and are thus stored. Since a bit stream generated at this time is not directly used (but is 

20 used for only the coding parameter in the coding), it does not need to be stored in the 
external DRAM 411. For example, the coding parameters are as follows. 

(In the case in which the coding parameter has the picture level) 

• a picture type, 

• a target bit, 

25 • an amount of generated codes 
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• a mean quantization step, 

• an f code (indicating a motion vector range), and 

• other statistics (a mean value, a distribution value and the like of a pixel). 
(In the case in which the coding parameter has the macro block level) 

5 • a motion vector candidate and an evaluation value thereof, 

• a quantization step, 

• a macro block type and a parameter value used for a decision 

• an amount of generated codes, and 
■ other parameters. 

10 As shown in Fig. 6, when the operation for coding an image in the half Dl 

format is once ended within a first half period of the frame, a second half coding 
operation is then started. The coding parameters obtained by the first half coding 
operation are sequentially read from the external DRAM 411 through the parameter 
input/output section 408 and necessary information is applied by referring to the same 

1 5 coding parameters as coding parameters for executing the coding operation. At this time, 
places for storing the coding parameters having the picture level and the macro block 
level are known in advance. Therefore, the parameter input/output section 408 can be 
obtained by reading required information from the external DRAM 41 1 if necessary. 

Fig. 7 is an explanatory diagram showing a memory map of the external DRAM 

20 411. As shown in Fig. 7, an original image area 12 corresponding to delay frames (n 
frames) for reorder and 2 -path coding, a reconfiguration image area 1 1 (corresponding to 
2 frames) for the coding, a bit stream area 13, a coding parameter area 14 and a reserved 
area 15 are mapped into an SDRAM memory area 10. 

As shown in Fig. 7, the coding parameter area 14 is further divided into a 

25 picture area 14p and a macro block area 14m, and the macro block area 14m is mapped 
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two-dimensionally (L X M). A parameter group comprising a motion prediction 
system parameter, DCT, a quantization system parameter, a generated bit amount 
parameter, various statistics, and luminance signal (Yl to Y4) and color difference signal 
(Cb, Cr) system parameters are stored in the macro block unit parameter MB (x (any of 1 

5 to L), y (any of 1 to M)) mapped two-dimensionally, respectively. The parameters of 
the parameter group are arranged to have a fixed length on a macro block unit. 

Thus, the macro block area 14m has the macro block unit parameters arranged 
two-dimensionally. Consequently, it is possible to obtain an advantage that an address 
can easily be generated for acquiring a parameter on the macro block unit. 

10 In the coding operation at a second stage, therefore, it is possible to randomly 

fetch a coding parameter in any area. More specifically, if the parameter on the macro 
block unit is stored in the macro block area 14m in the SDRAM memory area 10 as 
shown in Fig. 7, two-dimensional addressing can easily be carried out on the macro block 
unit. In the case in which reference is to be made vertically and transversely over a 

15 macro block in which a motion prediction related parameter group is a coding object, 
particularly, the parameter can easily be extracted. 

Fig. 8 is an explanatory diagram showing a specific example of the contents of 
the 2-path coding processing for a signal in the half D 1 format which is to be carried out 
by the coding LSI according to the first embodiment. 

20 Fig. 8 shows an example in which when an original picture input is carried out 

in order of Bl, B2, 13, B4, B5, P6, B7, B8, 19, BIO, Bl 1, P12, B13, B14 and 115 (I, P and 
B are I, P and B pictures, respectively), coding for the "P6" is carried out in two paths in 
the case in which coding order is 13, Bl, B2, P6, B4, B5, 19, B7, B8, P12, BIO, Bl 1, — . 

Fig. 9 is a flowchart showing a flow of the 2-path coding processing for the 

25 video signal in the half Dl format which is to be carried out under control of the coding 
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control section 407 according to the first embodiment. The 2-path coding processing 
according to the first embodiment based on the example of Fig. 8 will be described below 
with reference to Fig. 9. 

First of all, a first coding processing of the MPEG2 coder 402 is executed in a 
5 first half of the frame period at a step S 1 . 

For a period Tl in Fig. 8 corresponding to the first half of the frame period, a 
period is set in order of a picture preprocessing period tpll, a macro block processing 
period TMB31 and a picture postprocessing period tpl2. For the macro block 
processing period TMB31, the first coding processing for generating a coding parameter 

10 is carried out for the "P6'\ 

Next, a coding parameter (information for a coding processing) obtained by the 
first coding processing is stored in the external DRAM 411 at a step S2. More 
specifically, the coding parameter is transferred from the video signal input/output section 
403, the motion predicting/motion compensating section 404, the DCT/Q and IQ/IDCT 

15 section 405 and the variable-length coding section 406 to the parameter input/output 
section 408 through the coding control section 407, and the parameter input/output 
section 408 stores the coding parameter in the external DRAM 411 through the SDRAM 
interface section 410. In this case, the coding parameter obtained by the first coding 
processing is stored in the SDRAM memory area 10 of the external DRAM 41 1 as shown 

20 in Fig. 7. 

Then, a second coding processing of the MPEG2 coder 402 is executed in a 
second half of the frame period. In this case, the coding parameter obtained at the step 
S2 is utilized. 

For a period T2 in Fig. 8 corresponding to a second half of the frame period, a 
25 period is set in order of a picture preprocessing period tp21, a macro block processing 
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period TMB32 and a picture postprocessing period tp22. For the macro block 
processing period TMB32, the second coding processing for generating a bit stream 
signal SBS is carried out for the "P6". 

In this case, the coding parameter obtained by the first coding processing is read 
from the SDRAM memory area 10 of the external DRAM 411 and the second coding 
processing is executed by using the coding parameter. Consequently, it is possible to 
obtain the bit stream signal SBS which is coded more efficiently. 

The coding parameter stored in the external DRAM 411 is transferred to the 
parameter input/output section 408 through the external DRAM 411. The parameter 
input/output section 408 gives the acquired coding parameter to the video signal 
input/output section 403, the motion predicting/motion compensating section 404, the 
DCT/Q and IQ/IDCT section 405 and the variable-length coding section 406 through the 
coding control section 407. 

Thus, the coding LSI 401 according to the first embodiment can carry out a 
coding processing based on the 2-path coding processing for one frame period over the 
"P6" of the same frame (the nth frame) in the half Dl format. 

Accordingly, both of the first and second coding processings are executed by 
using the same MPEG2 coder 402. Therefore, it is not necessary to increase a resource 
for the coding in the first and second coding processings. In addition, the first and 
second coding processings are continuously carried out without providing a pause period 
within one frame period. Consequently, the 2-path coding processing can efficiently be 
carried out. 

Moreover, the 2-path coding processing for the same frame is executed. 
Consequently, the coding for one frame can completely be executed for one frame period. 

In the specific example shown in Fig. 8, there has been described the 2-path 
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coding to be carried out when the resolution conversion in the half Dl is performed. 
Referring to the 3/4 Dl and 2/3 Dl formats, in an MPEG2 coder having a coding 
throughput having a current TV size according to the conventional art, the 2-path coding 
method described above has an insufficient throughput, and the throughput should be 1.5 
times as much as that of the current (MP, ML) MPEG2 coder (a double of 3/4) when the 
2-path coding in the 3/4 Dl format is to be executed and should be 1.33 times as much as 
that of the current (MP, ML) MPEG2 coder (a double of 2/3) when the 2-path coding in 
the 2/3 Dl format is to be executed. It is possible to obtain an advantage that the 2-path 
coding can be implemented for a shorter processing period than that in the case in which 
2-system MPEG2 coders are simply connected in series in a general way (Fig. 3). 
<Second Embodiment 

In the structure and coding operation according to the first embodiment, there 
has been described the case in which the coding operation (the first coding processing) 
and the actual coding (the second coding processing) for obtaining a 2-path coding 
parameter are intended for the same frame. 

In a second embodiment, processings intended for different frames are executed 
between the first coding processing and the second coding processing for obtaining a 
2-path coding parameter. 

Fig. 10 is an explanatory diagram showing a 2-path coding sequence to be 
executed by a coding LSI according to the second embodiment. 

Fig. 10 shows an example in which when an original picture input is carried out 
in order of Bl, B2, 13, B4, B5, P6, B7, B8, 19, BIO, Bll, P12, B13, B14 and 115, coding 
for the "19" and the "P6" is carried out in two paths in the case in which coding order is 13, 
Bl, B2, P6, B4, B5, 19, B7, B8, P12, BIO, Bll, — . 

For a period Tl in which coding in a first stage is to be carried out, a period is 
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set in order of a picture preprocessing period tpll, a macro block processing period 
TMB41 and a picture postprocessing period tpl2. For the macro block processing 
period TMB41, the first coding processing for generating a coding parameter is carried 
out for the "19". The coding parameter obtained by the first coding processing is stored 
in an SDRAM memory area 10 of an external DRAM 411. 

Fig. 11 is an explanatory diagram showing a memory map in the SDRAM 
memory area 10 of the external DRAM 411 according to the second embodiment. As 
shown in Fig. 1 1 , a coding parameter area 1 7 is divided into partial coding parameter 
areas 17a to 17d. A bit stream area 13 is constituted by partial bit stream areas 13a to 
13d corresponding to four frames, which is not shown in Fig. 7. 

When the coding parameter is generated for the "19" a coding parameter for the 
"P6" obtained by the first coding processing is stored in the partial coding parameter area 
1 7a, a coding parameter for the "B4" obtained by the first coding processing is stored in 
the partial coding parameter area 17b, and a coding parameter for the "B5" obtained by 
the first coding processing has already been stored in the partial coding parameter area 
1 7c. The newest coding parameter for the "19" obtained by the first coding processing is 
stored in the partial coding parameter area 1 7d. 

More specifically, in the second embodiment, the coding parameters obtained 
by the first coding processing for three succeeding frames (an (n + l)th frame to an (n + 
3)th frame) as well as the actual coding object frame (an nth frame) are utilized for the 
same frame (the nth frame). 

For a period T2 in which coding in a second stage is to be carried out, a period 
is set in order of a picture preprocessing period tp2 1 , a macro block processing period 
TMB42 and a picture postprocessing period tp22. For the macro block processing 
period TMB42, the second coding processing for generating a bit stream signal is carried 
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out for the "P6'\ In this case, there are used the coding parameters corresponding to 
four frames (P6, B4 ? B5 and 19) obtained by the first coding processing which are stored 
in the coding parameter area 17. 

In the second embodiment, thus, the first and second coding processing for 
different frames are executed. Consequently, the coding can be carried out more 
efficiently. More specifically, the coding processing based on the 2-path coding 
processing utilizing the coding parameters corresponding to the four frames for the "P6" 
of a frame in a half Dl format is carried out for one frame period. Consequently, the 
coding can efficiently be carried out. 

In the second embodiment, accordingly, coding control can be carried out more 
efficiently so that a picture quality can be enhanced. Moreover, all the coding 
parameters corresponding to the four frames do not need to be applied but may be utilized 
properly and selectively if necessary. 

<Third Embodiment 

In the first embodiment, there has been described the case in which the coding 
operation in the first half of the frame is carried out for extracting the coding parameter 
and the bit stream output therefrom is not used. 

In a third embodiment, a bit stream signal SBS obtained by a first coding 
processing is stored in an external DRAM 411 and is utilized again. In the third 
embodiment, moreover, processings intended for different frames are executed between 
the first coding processing and a second coding processing for obtaining a 2-path coding 
parameter in the same manner as in the second embodiment. 

Fig. 12 is an explanatory diagram showing a 2-path coding sequence to be 
executed by a coding LSI according to the third embodiment. 

Fig. 12 shows an example in which when an original picture input is carried out 
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in order of Bl, B2, 13, B4, B5 3 P6, B7, B8, 19, BIO, Bll, P12, B13, B14 and 115, coding 
for the "P6" is carried out in two paths in the case in which coding order is 13, Bl, B2, P6, 
B4, B5,I9, B7, B8,P12,B10,B11, - . 

For a period Tl in which coding in a first stage is to be carried out, a period is 
set in order of a picture preprocessing period tpll, a macro block processing period 
TMB51 and a picture postprocessing period tpl2. For the macro block processing 
period TMB51, the first coding processing for generating a coding parameter and a bit 
stream signal is carried out for the "19". A first bit stream signal obtained by the first 
coding processing is stored in a bit stream area 16 of an SDRAM memory area 10 of an 
external DRAM 41 1. 

There has also been stored, in the SDRAM memory area 10, a first bit stream 
signal obtained by the first coding processing for last three frames (an nth frame to an (n 
+ 2)th frame) which has already been carried out. 

In the same manner as in the second embodiment, moreover, the coding 
parameters obtained by the first coding processing for three succeeding frames (an (n + 
l)th frame to an (n + 3)th frame) as well as the actual coding object frame (the nth frame) 
are also stored in the SDRAM memory area 10 for the same frame (the nth frame). 

Fig. 13 is an explanatory diagram showing a memory map in the SDRAM 
memory area 10 of the external DRAM 411 according to the third embodiment. As 
shown in Fig. 13, a bit stream area 16 for one path is provided in addition to a bit stream 
area 13. A bit stream signal obtained by the first coding processing is stored in the bit 
stream area 16 for one path. The bit stream area 16 is also constituted by partial bit 
stream areas 16a to 16d corresponding to four frames in the same manner as the bit 
stream area 13. 

For a period T2 in which coding in a second stage is to be carried out, a period 
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is set in order of a picture preprocessing period tp21 5 a macro block processing period 
TMB52 and a picture postprocessing period tp22. For the macro block processing 
period TMB52, the second coding processing for generating a second bit stream signal is 
carried out for the "P6". In this case, coding parameters corresponding to four frames 
(P6 ? B4, B5 and 19) obtained by the first coding processing which are stored in a coding 
parameter area 1 7 are used in the same manner as in the second embodiment. 

Total bit amounts and the like are compared between the first bit stream signal 
(stored in the bit stream area 16) and the second bit stream signal (stored in the bit stream 
area 13) corresponding to the frame "P6" stored in the bit stream area 16 for one path. 
Either of the first and second bit stream signals which is decided to be coded in an 
efficient state can be sent as a bit stream signal SBS (an output bit stream signal) which is 
actually output from a bit stream output terminal 414. 

In the third embodiment, thus, the first and second coding processings for 
different frames are sequentially carried out, and at the same time, the bit stream signal 
SBS is selectively determined from the first and second bit stream signals corresponding 
to the same frame. Consequently, it is possible to send the bit stream signal SBS in such 
a state that the coding can be carried out more efficiently. 

<Fourth Embodiment 

Fig. 14 is a block diagram showing a structure of an image coding apparatus 
according to a fourth embodiment of the present invention. As shown in Fig. 14, the 
image coding apparatus is constituted by a coding LSI 501 and an external DRAM 411. 
An MPEG2 coder 502 in the coding LSI 501 has two kinds of motion predicting/motion 
compensating sections 404A and 404B (first and second partial coding sections) which 
carry out a similar motion prediction/motion compensation and have different contents. 

The motion predicting/motion compensating sections 404A and 404B are 



23 

controlled by a coding control section 407, and the motion predicting/motion 
compensating section 404A is used in a first coding processing and the motion 
predicting/motion compensating section 404B is used in a second coding processing. 
The motion predicting/motion compensating section 404A carries out a motion prediction 
processing (a first partial coding processing) having a wide range and a low density, and 
the motion predicting/motion compensating section 404B carries out a motion prediction 
processing (a second partial coding processing) which has a narrow range and a high 
density. Since other structures are the same as those of the coding LSI 401 shown in Fig. 
4, the same portions as those in Fig. 4 have the same reference numerals and description 
thereof will be omitted. 

With reference to Fig. 8 used in the first embodiment, description will be given 
to a 2-path coding processing to be carried out by the coding LSI 501 according to the 
fourth embodiment. 

For a period Tl in which coding in a first stage is to be carried out, a period is 
set in order of a picture preprocessing period tpll, a macro block processing period 
TMB31 and a picture postprocessing period tpl2. For the macro block processing 
period TMB31, the first coding processing using the motion predicting/motion 
compensating section 404A is carried out for the "P6". 

The first coding processing is mainly carried out for generating a coding 
parameter for a motion compensation, and the coding parameter obtained by the first 
coding processing is stored in the coding parameter area 17 of the SDRAM memory area 
10 in the external DRAM 41 1 as shown in Fig. 7. 

For a period T2 in which coding in a second stage is to be carried out, a period 
is set in order of a picture preprocessing period tp21, a macro block processing period 
TMB32 and a picture postprocessing period tp22. For the macro block processing 
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period TMB32, the second coding processing using the motion predicting/motion 
compensating section 404B is carried out for the "P6'\ 

In the second coding processing, it is possible to narrow a search range by using 
the coding parameter obtained by the first coding processing. Consequently, it is 
possible to carry out a motion compensation by a search at a high density (with high 
precision) using the motion predicting/motion compensating section 404B without 
adversely influencing a processing time. 

By carrying out the first and second coding processings by means of the 
different motion predicting/motion compensating sections 404A and 404B, thus, it is 
possible to carry out a motion prediction/motion compensation which is more suitable for 
the first and second coding processings. 

While the first and second coding processings for the same frame have been 
carried out in the same manner as the contents of the processings according to the first 
embodiment, it is also possible to employ such a structure that the first and second coding 
processings for different frames are carried out in the same manner as the contents of the 
processings according to the second and third embodiments. In short, it is preferable 
that the motion predicting/motion compensating section 404A should be used in the first 
coding processing and the motion predicting/motion compensating section 404B should 
be used in the second coding processing. 

While there has been described the example in which plural kinds of motion 
predicting/motion compensating sections are provided as arithmetic units (partial coding 
sections), plural kinds of arithmetic units (a video input/output section, a DCT/Q and 
IQ/IDCT section, a variable-length coding section or a parameter input/output section) 
may be provided to use different kinds of arithmetic units between the first and second 
coding processings. 
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More specifically, it is possible to implement effective 2-path coding by 
providing plural kinds of effective arithmetic units in the 2-path coding. Moreover, it is 
also possible to have such a structure as to properly select either of the arithmetic units to 
be used in the coding operations for first and second paths by means of a switch. Thus, 
5 flexible coding can be implemented. 

While the invention has been shown and described in detail, the foregoing 
description is in all aspects illustrative and not restrictive. It is therefore understood that 
numerous modifications and variations can be devised without departing from the scope 
of the invention. 



